Papers by Kai Fong Ernest Chong
Global Adaptive Momentum Meets Local Personalized Perturbation: Efficient Federated LLM Fine-Tuning with Zeroth-Order Gradients (2026.acl-long)
Copied to clipboard
| Challenge: | federated fine-tuning of large language models provides privacy-preserving approach to deploying pervasive generative AI services. |
| Approach: | They propose a federated framework for fine-tuning large language models . they propose unified optimization and local personalized perturbation for ZO gradients . |
| Outcome: | The proposed framework outperforms existing methods for integrating ZO gradients in federated learning over diverse heterogeneous data settings. |